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ABSTRACT 

An evaluation of what comprises an effective 
educational information system, where we now stand with regard to 
such systems, and how we can improve these systems^ so that they are 
usable for educational decision makers and practitioners at all 

The needs for a multi*level information system, interpersonal 
communication ”a warm and walking computer terminal,’’ tailoring of 
information to the users* requirements, and information sources that 
are extremely accessible to the user are stressed. A survey of 
teachers and principals indicated what respondents want from an 
information system is: (1) accessible information, (2) current and 

comprehensive information, (3) rapid response to queries, (4) 
verification of reliability and (R) flexible products and flexible 
services. (ME) 
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Thonitis ClGwcns, Chief i KGseairch Utiiissstion Branch 
United States Office of Kducation 

Today I should like to talk v:ith you about four questions. First of all: 

Why’ information systems in education?; Why do we need them or why might people 
vant them? Secondly: What comprises an effective educational information 

system? Third: Where do we now stand with regard to such systems? Fourth; How 

can we go about improving these systems so that they are usable for educational 

decision makers and practitioners at all levels? 

Perhaps the most used and abused word in education today is innovation. 

The relationship of information use to innovative programs, I assume, is obvious. 
It’s surprising, however, how many presumably innovative programs around the 
country in education in the past few years have had no verifiable knowledge base 
whatsoever. They have been innovations, or inventions, right off the top of the 
head, growing out of intuition. Such Inventioiis, of course, are fine, but I 
think that for most of us, and most school districts and state agencies, it is 
Important to make sure that our flash, of insight is somehow or other verified, 
against evidence from other sources. So, one d'rea where an information system 
, can make a contribution, is in planning programs to change schools. There are 
other uses too, however, and I'll try to elaborate on these a little. Let's 
look at knowledge utilization in two ways; first of all, from the standpoint 
of information using behavior among educators, -and secondly in terms of possible 
benefits of such use to educational organizations. 
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From a behavioral standpoint, let*s consider what evidence is available 
about hov7 educators use information, why they ask for it, and, presumably, vdiy 
they use it. I suppose it comes as no surprise to anyone that one of the most 
frequent uses of objective, scientific information by decision makers and 
practitioners in education is to justify what they arc already doing. This 
Is something that a lot of people shake their heads over. However, it seems to 
me that if you’re going to justify what you’re doing by any means, it is better 
to do it with information, rather than rhetoric, or doctrine or something else 
of this sort. There are, though, other uses as well. Secondly, every teacher 
uses information to complete everyday tasks. Insofar as wc can provide the 
teacher needed information, in a systematized and updated way,-V 7 e can facilitate 
this completion of day-to-day tasks. Third, v/e can use it to decide how well 
V7c’re doing, where V7e stand. A knowledge base provides the basis for a start 
on evaluation in education. Fourth, inforiration, by changing our conceptual 
vlev7s of education, can he].p us to define educational problems/and needs more 
precisely, more clearly, and more operationally. Of course, it can also • 

facilitate decision making. Clearly, a decision based upon information is ’• 
something greatly to he desired, although very frequently the knowledge base 
upon V 7 hich educational decisions are made is pretty narrow as we' all know. 
Finally, having made a new decision, information systems can help to' implement 
it, through drax'7ing upon the experience gained in other settings. What we can 
say, then, as to, the why of using formal information systems in education is 
that they can help us to define problems and make decision; to implement 
decisions; to carry on our every day operations, whether V7C are changing from 
previous behavior or not; and, finally, as a basis for evaluation. Nov 7 , enough ^ 
on that; let’s talk a little bit about what it is that comprises an effective 
education information system. "• ' 
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We have a lot less information on effective information systems in education 
than we might like, but V 70 , do have tv/o bodies of literature which can be of 
benefit in defining rccj;ulrements of information systems. First of all, there is 
the so-'called diffusion of innovations literature, which is concerned with 
adoption of nev? practices and inventions; secondly, we have the literature on 



Information science. Let me draw on some of this literature, and later, as 
best I can, relate it to conditions and constraints in education, plus what we 
know about Information utilization in education itself. 

Everett Rogers of Michigan State University, in his book Dif fusi on of 
In nov at ion s , describes the process of adopting innovations as a special kind of 
decision making. He says that when a person makes a rational decision to adopt 
something nev 7 or different, he goes through a number of stages. You rarely 
find any of these stages skipped if a decision to change is made. The Initial 
stage (hardly surprising) is av7arencss that some alternative to current practice 



exists. Having become aware, a cosmopolite, motivated person will demonstrate 
interest in the innovation by trying to get more specialized information about 
the topic. Having had his interest answered with more information, he then < 
engages in a kind of an in-the-head evaluation of whether this new phenomenon 

% t 

relates to him, V7hether it promises higher rewards than his current practice', 
the problems he lives with, and so forth. If! the answer to this evaluation is 
favorable, he is likely then to. go through a period of trial of the innovation 

V 

on a limited scale to see V7hether the innovation does indeed v7ork for him. \ 

Another purpose of the. trial period is to allow necessary adoptation of the /in- 
novation to the ].ocal setting. Finally, if the trial is successful, the rational 
innovator then adopts; e.g., ho goes ahead and makes use of the Innovation on a 
continuing operating basis until it*s replaced by something better. Nov7, the 
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interesting thing is that as the person is going through this adoption process, 
he uses different information sources at every stage in the adoption process. 
Normally, particularly for the early adopters, av/areness comes from mass^media — 
from technical reports perhaps, and from the kinds of testamonials^ about new 
practices that characterize much writing about education in newspapers and 
magazines. \^en he gets to the point where he is interest and wants to know more 
the potential adopter is not satisfied V7ith the kind of superficial information 
found in such testamonlals . He now wants materials which interpret what the 
innovation is about in some detail and the situations in which it has been tried. 
He very well may not be satisfied V 7 ith just receiving news clipping's or a b5.blio- 
graphy, but this is more likely to be true if he is a fairly cosmopolitan person 
who goes to original information sources. For the less cosmopolite adopter, 
personal tv70“V7ay communication V7ith an earlier adopter is more likely to provide 
the most relevant response to his interest. 

I'/hen tlie adopter gets to the valuation stage, he relies heavily on inter,- 

personal communication; he will go to the people who have tried it, who have 

lived V7ith the problem. As Rogers puts it, during the pre-trial evaluation ' 

adopters are more likely to believe people than documents. The resjult is that 

In medical, agricultural, and particularly educational settings, there is a' 

« * 

heavy reliance on interpersonal communication during the. pre-trial evaluation 
stage. During the trial and adoption stages, we find ever-increasing emphasis 
on Interpersonal contacts and communication. There is some recent evidence,, 
however, that certain kinds of specialized, interpretive material can be of ' 
help at this stage in getting people to make whatever is. the right decision "i 
for them, and in many cases that the right decision is to reject rather than 
to adopt an innovation. This then is how the diffusion researchers look at the 
- use of information and information sources in;maklng decision to change. 
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Let’s nov 7 look at evidence provided us by information scientists, and see 

how science-oriented practitioners and scientists themselves seek out infer- 

% 

mation. A useful source of information is Herbert Menzel of Columbia University, 
whose investigations have resulted in one of the seminal articles in the field 
of Information science.^ In this article he identifies a variety of different 
approaches to decision making, or to information gathering, by both scientists 
and technologists. Note that this relates at least to some degree to V7hat was 
said earlier about how teachers and administrators seek out information. The 
first pattern is what Mensel calls the cu rrent approach , in which the information 
seeker attempts to stay up to date in a field in which he is already competent. 
The information systems developments, techniques, and products which are re- 
sponsive to this current approach are called current av7areness searches. 

Selective Dissemination of Information, and a lot of other jargon which we shall 
not go into at this time. Secondly, Menzel has described V7hat he calls the 
everyday approa ch . An example is the engineer who doesn’t c3.utter up his niind 
trying to remember the boiling point of lead under certain conditions, but uses 
a handbook for this. We might point out, that the teacher also uses this kind 
of everyday approach, when she looks at the cumulative record of a student at 
the beginning of the year, or V7hen she attempts to draw on additional sets of. 
information in order to make a decision about hov7 to deal with this class or 
this particular youngster regarding some Instructional or other classroom problem 

Again, this process requires a different kind, of information from simply the 

( 

current awareness V7here you^re trying to tap everything coming out as it comes 
out. Third, there is v;hat Menzel calls the exhausti ve ap proach. Here again, -a 

Hlenzei, Herbert. ’’Types of Information Seeking,” Library Qua rterly , Vol. 

34 ( 1964 ). 
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person who is competent in a given area, before starting some new and pre- 
sumab-ly major project, attempts to find out everything he can that relates to 
this particular problem in his field. I guess one of the closest examples 
you'll find of this in education, is somebody writing a proposal for a Title 
III project, although I am sure that there are other examples of program plan- 
ning at the school board level and elsewhere. The fourth approach is what he 
calls the bru sh-u p appro ac h. This is where the individual attempts to collect 
Information in an area where he is not highly knov7ledgeable. If, for example, 
you have an information scientist who is tryi.ng to learn what to do about an 
educational information system, he knows information science, but he has to 
learn very quickly and very efficiently about the problem of what this sub- 
culture v?e call education is in the United States. Again, I think you may infer 

•* 

that the brush-up approach leads to a need for different kinds of Information 
and information products than those required for other purposes. Finally, “ 

Menzel describes the browsing a pproach , in V7hich, on a more or less random basis j 
one skims through catalogues or indexes of journals, or other sources outside 
of one's pre-determined field of Interest. It is in this area, of course, where 
big flashes of insight occur sometimes j and where inventive persons see tv7o ‘ 
things fitting together which they never really thought about fitting together 
before. There is one other thing that I think I ought to point out here, an 
insight provided by \7illiam J. Paisley of Stanford; communication of information 
occurs in two different dimensions. One is Paisley calls horizontal communication, 
in which, information is communicated at essentially the same level of expertise 
as that at which it was orginated. Horizontal communication is the kind that 
occurcs in professional associations, for example, V7here two learning psy- ' 
chologists will keep in touch about each others research. They are at the same 
•level of expertise and they are sharitig scientific information. The other kind 
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of communiatj.on, which is of particular Importance to us here today, is v?hat 
Paisley calls vertical communication, V7here information is transmitted from one 
level of expertise to another, usually from a higher to a lower level. A good 
example of this would be where the pharmaceutical industry is working with bio- 
chemists and others to develop certain kinds of Infox'mation and guidelines 

V7ith regard to a new drug, and may communicate this through the physician who 

•. I 

is at a lovjer level of expertise in pharmacology and bio~medical science. The 
same thing, I. think, applies in education, v.’here v;e have highly structured 
vertical communication channels. One of the problems in talking about com- 
munication in education is that we often assume that the educational scientist/ 
researcher is necessarily more expert than the educational practitioner with 
regard to any problem related to education. I think vje all have seen instances, 
however, where it v7ould be useful if V7C .could educate the educational psy- 
chologist or educational sociologist about what it is really like in the class- 
room. So V7e have some kind of need for two-way vertical communication, in 
education. 

From these points, I would like to suggest -that there are a number of 

generalizations V7e can draw about information systems. First of all, if an 

information system Is to v7ork, and to 'be effective and useful for people, it 

V7ill have to provide a variety of different forms of information. You can’t 

be satisfied with just research reports, or with progress repo.rts or biblio- 

giaphic listings, oi* Interpretations, alone — you must have a variety of Infor— 

matj.on products. This is true, because, first of all, in a complex field like 

education, there are many different educational roles, and the people in these 

different roles need different forms of information to perform their jobs. 

Secondly, even v7ithin a given role, the superihtendenCy , for Instance, the role 

♦ 

incumbent performs not just one, but a number of functions. The superintendent 
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is not just a decision-maker, he. performs other managoi^ial functions as well, 
so he needs different information for different functions he performs. 

Similarly, the teacher is not always a practitioner, or clinician, but is some- 
times a decision maker j she will need different kind.*; of information for each 

of the functions she fulfil].s. Furthermore, each of these people will need 

✓ . 

different forms of information for different stages in their professional 
development. If one is at the Interest stage in the Rogers paradigm for example 
one needs one kind of , information, which is certain.ly different from the infor- 
mation and information formats needed when actually trying out some Innovative 
programs. 

Another generalization is that Information sources must be extremely 
accessible to the user. User studies in the information science field have 

■t 

repeatly shown that the first information source used and the most frequently 
used information source is the one which is closest at hand to the user; and 
hold on now t|^s u ser do es not think it is ve r y good . Bad Information 

V7ill drive out good Information, if good information is inaccessible. Also, 
as you may have inferred from some of my comments, inter-personal communication 
is vitally important both for the practice-oriented and the research oriented 
person. It has been said that, ”if you’re going to have a computerized infer- 
mation system, the computer terminal had better be vavm and walking.” People 
learn more from other people than from objective sources because interpersonal 
communication permits adoption of the message to the user’s prior knowledge 
and needs in a way that simply scanning documents does not. And finally, there 
Is a phenomenon that some people call user apathy. Paisley calls it user non- 
chalance, which means that most people simply are not going to try to use infor- 
mation sources unless they are readily, accessible. I would suggest — well. I’ll 

talk about user apathy V7ith regard to education a little later — but simply • 

\ 



because you have a good inforiuatiou syst'.etu, doesn’t mean that it is going to bo. 
used, You're going to have to work aggressively to make sure that people do 
use verifiable information in making decisions. Let's try to relate this more 
close3.y to education. Most of the information science literature grov7s out of 
big information systems like the Defense Documentation Center, the NASA Data 
Bank, and siralliar facilities. In those kinds of Information systems, there Is 
very clearly a reward system for using information because Information can be 
translated into nev 7 inventions and products which mean profits for the people 
who use the information. Similarly, the physician and the farmer use information 
because, information means more yield per acre, shorter treatment time, or what- 
ever. Our problem in education, of course, is that our reward system is not 
clearly re..lated to productivity in the sense that reward systems in other fields 



arc. \i?hat is the payoff for doing things differently or better in education? 

It depends upon the setting, hut by *and large, I V70u.ld submit that it is harder 
to identify relative advantage and payoff V7ith Information use in education ' 
than in agriculture, medicine, or in industry. Put another way, education has 
had a fairly limited scientific tradition, our root.s are much deeper in the 
humanistic tradition than in the scientific tradition. Remember, just about 70 
years ago the first real educational experiment was run. This V7as Rice's study 
on spelling and he was sneered at when he reported that he had tried out tV70 
different v;ays to teach spelling, and it was clear that the kinds could learn 
more with one method than with the other. The reaction of the educational 
community was, "whatever made you think that you could. decide how well child- 
ren spell by observing their spelling behavior?" Presumably, disputation or 
something else was the favored mode of solving educational problems. Some of 
this Is still with us today, althoigh to a lesser degree. If you'd look into 
.■some of Philip Jackson's V 7 ork here in the state of Michigan on va.lue systems 
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and rewairds fot teachers, you find that teachers just don*t trust objective 

information very much at present, They be,He.vc that a testing program, for 

% 

example., is something that is imposed by somebody else, for the values or 
benefits unrelated to teacliers or pupils. They don't see objective measurement 
as a tool of use to them; so I would suggest that one of our problems in an 
educational information system is that our scientific tradition is much more 
shallowly rooted, and much narrov/er than some other fields. 

Another problem, of course, in trying to use iniormation in education is 
that we have a very wide range of goals and some of these goals are conflicting. 

I came from a part of the Midwest where one of the biggest impediments to 

t • 

school district reorganization was that we would lose our basketball teams if 
we reorganized, despite the face that there were strong cas^.s made that youngsters 
would learn more in the reorganized school district. I would suggest that in 
education there is almost excessive reliance, on interpersonal communication. 

Some, of the studies done by the. Far West Laboratory for Educational Research 
and Development, and others, have indicated that virtually the only source of 
Information used in some Title III projects by?the person writing the proposal 
has been other people who are trying the same kind of thing. Visitation and 
inter-personal communication is sometimes used to the exclusion of any docu- 
mentary or reproducible evidence about a given kind of innovation that a Title 
III center is trying to implement. Yes, we have information user apathy in 
education r If .user apathy were a disease, there would be two major syndromes 
in education. The first syndrome is the "Don'^t confuse me with the facts 
syndrome, which characterizes, frequently, the r administrator or practitioner 
.who is afraid that if he gets information that goes counter to v;hat he is 
doing, he'll be expected to change. The other .syndrome in thj.s di.ead disease 
of information apathy is the,, ’’Please mother, I'd rather do it myself," syndrome. 
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This second syndrome is irequenUly found in the innovative educator and cer- 
tainly in the educational researcVjer, who would much rather replicate an experi- 
ment or demonstration than find out vjhcthcr it has worked some place clseT This 
phenomenon happens time, after time, after time, If you don't believe it, look 
in Tacesetters at the number of redundant programs that are going on, even in 
one state, under Title III, which have already been losers in otlier'places at 
other times. 

What does this all imply So far as the requirements for an educational 
Information system? Let's examine what little evidence we have on use of 
information in euucation. The Far VJest Labovatory for Educational Research and 
Development ran a survey using both questionnaires and interviev: of teachers and 
principals . to learn what the respondemts wanted from an Information service. 
Remember that this kind of questions is a very difficult thing to ask of a 
practitioner who has not had access to highly sophisticated information systems. 
Frequently, V7hat you get from this kind of study is the equivalent of suggestions 
that the buggy whip he near the gearshift XcvcAh But at the same time, unless 
you understand v;hat the requirements of the user.'are, you're not going to he 
able to design a system which is indeed useful. • In rank order, what these people 
wanted V7a,s first of all-information that they could easily get at. That was 
far and av7ay, the numbeir one requirement. Unicsfj your Information system has a 
close outlet to the user, it's not going to he. used. Secondly, they were con- 
cerned with currency of Information. Clearly, there are many accessible infor- 
mation sources that don't have very much current information. (Remember thee 
yellowed lecture notes from your graduate school days?) The third factor is 

I, • , , 

comprehensiveness. Remember information apathy — somebody who is busy trying to 
teach kids , or operate a school cannot afford to run to a dozen different 
.information sources, which is all that we can offer today. They must have aiv^ 
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outlet' from :tliis vast lufonnaticm system that gives them comprehensive coverage 

» • • , 

r»o they don’t have to go to a number of sources. Fourth, they want rapid ansvjers 
when they ask a question; you can’t have a system which takes a long time to 
provide the information required. Fifth, they’re interested in making sure 
that the information has been evaluated so there is some sort of verification 
of its reliability — although this does not necessarily mean scientific reli- 
ability. Sixth (notice that this is not nearly as Important as some of the 

, t * 

/ 

others here) they want thorough documentation. They want to know v/ho did it 
when, where more information is available, and so forth. And finally, they 
v/ant flexible products and flexible services. If they come and say "I have a 
headache” and you say ’’fine, here’s Excedrin" O.K. But if they say, "I think 
my leg is broken” and you staill say ’’Fine, here’s Excedrin,” your system is not 
going to have much credibility or utility to these people. So, again let me 
suggest that these requirements as stated by teachers and principals, plus what 
we have learned from the information science field, suggest than an educational 
Information system must provide a range of products related to user needs. I 
can’t stress that enough — unless the information system systematically draws 
upon the users to find out about user behavior, characteristics, and requirements 
it is in. trouble. There must be readily accessible services and there must be 
the possibility of interpersonal communication — the warm and walking computer 
terminal. Make sure that you maxirnl^^e, to the degree which your system allows, 
inter-personal communication because this is the way educators behave. 

What v/ould a system look like, then, that would involve all of this? Th‘e 
system can be described in terms of three, kinds of factors: its products. Its 

functions, and its services. Products can be divided into two groups: basic 

and derived. Basic products arc forms of information which arc acquired and' 
selected In roughly the format in which they’ 13. be disseminated. For example. 
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ERIC has as its hasic product documants which are collected and not rewritten. 

* i 

Data syssteras have data as their basic product^s. A third kind of basic product 
‘ 

Is referral material — lists of people and places, These are. the three basic 
products V7hic.h an information system can provide. These things are basic not 

' I 

only in the seiivse that they are distributed rough.ly in the form you acquire 
them, but also in the sense that they allow you to develop a range of more 

9 $ 

t « 

finished or derived materials. Kxamples of derived products are access tools 

4 

I 

which allow you to get into the information system (for example, abstracts and 
indexes), A bibliography is a derived information product, as are interpre- 
tative materials such as state-of-the-art papers, which you may prefer to call 
Information analyses, v^hich v/e'll discuss a little later. 

I • 

Now lot's consider functions of the system. An information system that's 

going to serve a v;ide and heterogenous user population, clearly has to acquire 

materials. I rememher a Hungarian friend of mine once telling me that the 

^ • 

first Instruction in a family recipe, for chicken paprikas-, was "first steal 
your chicken." Well, that's also true in information systems. The chickens 
to steal are docuinentwS, data^ and the names of people and places. But ac- 
quisition must be coupled v/ith evaluationv Remember the teachers said they 
vyanted this Information documented,- evaluated, --I'm sure that most of you have 
heard in the f amour computer acronym GIGO — garbage in garbage out. I would ‘ 
submit that in an, information system there is even a more disastrous form of 
GIGO, garbage in and gospel out. So, unless your documents, unless your input 
is evaluated to -.make sure, it's. not redundant, junJess you make sure that it is 
reliable and valid, you're simply going to be providing misinformation, and 
you're going to be swamping them with excessive material. Another broad 
function is the. range of technical processing functions — I don't x^;ant to be- 
labor this too much, but among the things that an information system has to do 
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is to provide intellectual access through abstracting and indexing maintenance 
of the files so that it is possible to know whore each piece of information is 
located; and then of course, the search of the file, as required is necessary for 
retrieval of the material. Still another function is that of information 
analysis, v^herc you attempt to tell people enough so that they do the job pro- 
perly rather tlian giving them everything you know. -Maybe I can give you an 
« • 

example of this. At the present time, let’s assume that: we. have a superintendent 
who is. either so rational or so demented that he decides he wants to look at 
evidence of the effectiveness of educational television, before making a decision 
about whether to have a instructional television program in his schools or not. 

If he asked of the ERIC Clearinghouse on Media and Technology or some other 
source, ’’Tell me what Is available about the effectiveness of instructional 
television?” he’d get ^«00 separate documents. No matter how rational or how 
demented that superintendent may be, he can’t afford to read AGO documents, 
and attempt to sift among them before he mades a decision. So, for certain 
kinds of information functions, you’d better make sure that your. information 
system analyses information according to user requirements. This doesn’t have 
to he on just' a one-to-one basis as demaiuled. , There are ways in which infor- 
mation analysis can have broader utility for many audiences. Basically, there 
are three kinds of information analysis activities, and they don’t necessarily 

all occur in the same locale. One is what they call the discipline-oriented 

* • 

analysis. . That is where you talk .about available evidence from the standpoint 
of psychology or. sociology or some other field, of academic study. A second' 
kind of inf or mat lion analysis, and one which has a great deal more utility for 
education in most, cases, is the mission oriented analysis, in which you draw- 
together and analyze information according to a consistent viewpoint, from V7hat- 
ever discipline, or field.s the original documents may come from, and relate it 
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to fi real life problem. This is a kind of tiling \?hich is done by the Defense 

Metals Information Aimlysis Center, Thirdly, there is something vc don’t nov7 

% 

have in education; a. type of analysis that I’d guess you’d call a census bureau, 
in vjhici! data, not documents, are collected on very broad phenomena, like oceano- 
graphy or metallurgy, or space physics. Where those data inputs are manipu- 
lated by computers and by other moans, in ordca* to try to extrapolate from the 
data and to generate hypotheses. VJe don’t have these kinds of census bureau 
Inforiijation analysis centers in education yet. Until we solve some defini- 
tional problems, where one man’s creativity is not necessarily another man’s 
neurosis, as it is today, V7e’re going to have trouble getting that kind of 
Information analysis. ; 

Another system function is dissemination, vjhich provides the user access to 
documents and other system products. The final system function is user services. 
Let me reiterate once more that an information system that does not relate closely 
to user requirements and user characteristics will be of little use and is not 

i 

v 7 orth the money required to support it. It is necessary, therefore, that the 
system receive continuous feedback from the user on how well he’s satisfied with 
the services provided, whether he feels he needs more information, and a variety 

of other questions. At the present time, we don’t have a single educational 

* * » 

information system in this country that is based upon user analysis. 



There has been a good deal of exhortation this morning about assuring 
. . 

accessibility of information. Well, how do you make it accessible? First of 
all, you don’t leave the poor teacher or principal out there in solitary 

* r 

% 

elegance with his ERIC Thesa urus , copies of Research in Education , and his micro- 
fiche reader. You attempt to relate him to the system in a variety of possible 

ways, of which one excellent example is the ASSIST Center in Wayne County. 

. * *■’ 

The system must provide some way of v 7 orking with the user to find out what it 
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Is he really wants, what inforraatlon is really relevant to his needs. Are 
there time liraits in terms of hov; fast he has to have, it? Are there limits on 
the time periods from v^hich he wants inforniation from? Does he want it going 
all the way hack to the year one, or does he want it over just the past three 
years? Are there any limitations on the sources of information so far as he 
is concerned? And vdiat are the proposes for which he wants the information? 

This last question is critical because it influences the relevance of the out- 

,, » » 

put for the system. Having ’.'negotiated" the query so that the information 
requirements of the user arc clear to both him and to his contact with the 
system the representative of the information system formulates a strategy for 
conducting the search of the information file. After conducting the search, 
the information specialist screens and analyzes the output from the search. 

He doesn’t conduct this screening in order to eliminate materials, since study 
after study has indicated that no matter how naive the user is, he is a better 
judge of the relevance of a given document or bit of 5.nformation to his needs 
than the most sophisticated information scientist. So this screening and 

f . 

analysis is intended to point up where there are agreeraents or conflicts in 
documents provided. At this point, the information specialist is ready to 
brief his client on the results of the search. < This may be over the telephone, 
face to face, or in v;ritlng to let the client know vjhat has been found and to 
learn whether there is need for additional searches or for referring the client 

I * • , 

to other sources, The information specialist should use this briefing as an’ 
occasion for getting feedback information from the client. This kind of empirical 
assessment of the program is essential in ordei' to keep grov;ing with the user, 
because as clients make use of information systems, they become increasingly 
sophisticated and if you have a sterotype of the user in your mind the effect 
is going to be to have a system that stands still while the users are growing. 
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In shorty thon> using Gcoirgei Gi‘iines’ tcrnis, an educational information 
system should include a management information system vdiich will involve data, 
statistics on personnel, facilities, costs and other matters that can be used 
for planning', for accounting, for evaluation and related purposes. Vc also 
need a technical information system (I think we're all a little uncomfortable 
with that term as George indicated) hut it is a system which is essentially 
based upon knowledge rather than data, not necessari 3 .y all quantified, and 
consisti.ng of rcisoaircli and clinical, evidence contained print and oU^er 
forms and information allowing referral of the client to other sources. One 

• * t 

think that I vjould ],ike to yioint out about these tv/o we sometimes like to talk 
as if v/e coul.d, witli enough resources, construct a monolithic educational 
information system in which both data and documents v 7 ould be thrown into some 
fiort of a hopper and all that we v7ould have to do is push the right button and 
out would come the right mixture of data and documents. I’m sorry--it isn’t 
so. It isn’t even so in the private sector. The president of the Auerbach 
Corporation, said once, tv70 or three years ago, that neither in American in 
dustry nor elsevjhcre in the world does he knov? of a single combi.ned data and 
document computerized system that can be used as a complete management control 
system. There just isn’t such a thing. The state-of-the-art is not yet that 
far developed. I tried to verify this vrith Dr. Ed Parker, another very com- . 
petent information scientist who knows education, and he says today, even today, 
that he doesn’t knov? of a single merged document and data system which is cost 
beneficial. So about all you can do at this tine is go down tv;o roads with^. 
separate data based and document systems and then attempt to get some sort of 
human interface betv/een them, rather than. attempting to throw all your data, 
and all your documents, into one file and think you’re going to get anything' 
•out of it. You can see, hov:ever, that betvreen these two types of systems v/e do 



have the basis for improving educational decision making and educational 
practices. . . 

Let me state my recurring theme again. In order to have a system that is 
accessible to the user, and providing a range of products, I would submit that 
vhat V 7 e need in* education in this country is a kind of a multi-level infor- 
mation system. There can be no monolithic system. I think one of the biggest 



problems v;e have v?ith regard to ERIC is people believing that the Office of 
Education sees ERIC as the all-sufficient dissemination instrument, and it 
can't be that. If ERIC can just be a kind of a scientific memory for education, 
it becomes a useful indeed, an essential component of multi-level infoimation 
system. But it can't do the job by itself. And it can't do the job for all 
users with the kind of products that it can provide. It seems to me that in 
a multi-level system v;e must have contact both with the teacher and admin- 
istrator, through information services like the ASSIST Center, V7hei.e there can 
be inter-personal communication and tailoring of information products to the 
user's recjuireiiients , but I wou3.d ].ike to stress particularly the importance, 
of the state education agency in a multi-level 'information system. Federal 
funds and systemsj can accomplish some tasks that could not be handled other-- 
wise. There are local outlets that provide accessible, responsible services 
that a federal system cannot; but, inbetween is the vital linking role of the 



state education agency. The state education agency is the natural link, the 
one between national resources and the local user. Historically, in this 
country both by tradition and by law, the State education agency has served 

s 

the role of leadership and advocacy for educational quality. Clearly, this 
kind of leadership role relates to making sure ^that the information is provided. 
Also, through its regulatory functions close the State agency can provide quality 
control in educational operations. Although the degree to which quality control 
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or regulatory functions are performed varies tremendously from state to state, 
the state agency is as close, to a quality control organization as there is in 
education at the present time. The state agency also provides another unique 
function: it provides staff service to both the state legislature and the 

state executive. Legislative proposals can and do emerge from state education 
agencies. Presumably, if an information system is available for internal use, 
it is easier to provide these kinds of staff services more effectively. So 
our grand design someday vill be: federal problems and other non-government 

national programs to carry on such functions as technical processing of 
various sorts, some major acquisition programs, and other activities requiring 
a national effort j the state in an intermediate role; and local user outlets, 
vhich may be at an intermediate district .level or in large urban areas, at the 
local district level. Under this kind of system, then, it would be possible 
to buck any function up as far as possible into the system to have it performed 
in a cost-beneficial way, and still have effectiveness of performance, for the 
user down belov?. 

I7ell, that gets us then through the questions I proposed to dificuss an 
Interminable time in the past. Where do we stand? If you look at these pro- 
ducts, services, and functions of the- state, local, and national level, I 
guess V7e* re better off in acquisition of documents and providing access to 
documents than we- are in any .other area. This, of course, is because you have 
ERIC, DATRIX, the School Research Information Service, and (I don’t know if any 
of you have seen ( it) the Current Index to Journals in Education .which provides 
a monthly index of journal literature in areas of interest to educators. But 
v/e’re very weak on the kinds of clinical information, if I can use that term, 
that comes out of. state education agencies and local .school districts. We are 

not getting that sort of material into ERIC, nor into the School Research 
/ 
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Information Service of Phi Delta Kappa. This is a place where the state can 
serve as a very useful collection point, to draw out such documents, screen 
them, and if they havc|just local utility, keep them in the state. But if they 
appear to have some utility at a level beyond. .the state, rather than dealing 
with them further, put them into ERIC, or School Research Information Service, 
so that you don*t have to waste your time and energy in trying to carry on 
technical processing that can be done by national components of the system. 

\«/hat of data? Actually, in many ways V7e*re weaker on data systems than we 
are on document systems in education. This is true for a variety of reasons, 
but there are some promising developments, like the Midvzest States Education 
Information Service and the Integrated Educational Information Service (lEIS) . 

With regard to information analysis, in the past most of this has been done 
by professional associations and then usually just for their members and nobody 
else. We are trying to support an information aiialysis program in the Research 
Utilization Branch which ends up in products like the PREP Kits which v;e send 
out to state agencies. PREP is the acronym for Puttin g R esearch into Edu ca- 
t ional Pract3.ee . This one, for example, is a guide for school administrators 
and broad merabers on instructional television ^facilities . It*s backed up by. a 
discussion by a highly competent administrator on financial and other con- 
siderations in using instructional televison. We have similar kits coming out 
in the area of reading — there are four on reading programs that are out now.:. 
You *11 be .seeing tsome others coming out on bilingual programs and a variety of 
other topics. T)ie contact for the Michigan State Department of Education is' 
Dr. Charles Ruffing. We provide these materials in camera ready copy to the' 
state agency. The reasons vie do this is two-fold, first of all, and most 
important, we want people to look to the state agency as a primary source of 
• information from research. Secondly, because of printing requirements of the 
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Joint CoiTimittcc on Printing and Binding, we V 70 uld have to go through the 
Govci'npicnt Printing 0’"ficc and all sorts of things to product these in quan- 
tities* Tlie resu3.t v.^ould be that the infornuition v/ould not be avai.labJ.e* 
quickly, so V 7 e crank them out in this semi-finished forin for the state agency, 

either to reproduce and pass on if they like, or if they would prefer, v;e d be 
, » 

delighted to sec them, re-package the information to fit unique state re- 
quirements and state con.straints . If the state agency wants to take the credit 
for it itself, and forget about the Office, that’s o.k., because we’re just 

interested in getting the information used. 

Technical processing— well 1 think the ERIC system provides a useful 
procedure that can be used at any level, through its use of controled lan- 
guage and so forth. 

Client services provide a rather mixed picture. VJe have just contrncted 
with the Systems Development Corporation to identify what was going on in 
information in education. They surveyed more than 2,000, educational agencies 

I 

and they could find only 397 information .centers through all the country , only 
397 infojrmation centers, that met just tv/o criteria. The first criterion was 
that the center include at least' one of the fo3 lowing functions: reference, 

bibliography compilation, review preparation, abstracting, indexing, loan 
(either direct or inter-library), literature searching, or referral service. 
These agencies only had to have one of those, services. And so far as holdings 
(the second criterion) all they had to ,do was have some hooks, periodicals, 
reports, or a significant ERIC collection. Of. the 397, only 126 gave- anything 
like comprehensive coverage,, covering all the topics of interest to school, 
personnel. Most of the others were curriculum and material centers, Research 
Coordinating Units for vocational and technical education information, cxcep— 

• tional education information centers, and other special centers which cover 
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alwoat subject: that: you can Imagine. 01: the 39V, 317 arc Title IH projects, 

* ♦ 

31 arc state vocational research coordinating units, and only 13 arc state 
education information agencies, Over 190 of these information systems had a 

knowledge base of less than one~thousand books,’ journals, and periodicals, 

» 

and less than 25 had book collections as big as five thousand items. Less 
than one-half had any reference volumes at all. So, clearly, we* re in great 
need for state level services in this country if we V7ant people to have i^ifor- 

I 

matlon for more rational decision making. 

Maybe one other area to talk about is what kinds of developmental efforts 

.1 , 

are underway. I*ve mentioned the Far West Lab*s efforts. MORKL and what it 
did with its referral and data system is tremendous. The Ohio Education 
Association has adopted the MORE!., system .in order to provide information ser- 
vices to Ohio educators. We currently have a contr.jct in the Office with 
Auerbach Corporation, to identify alternative models for multi-level infor- 
mation systems, and the project staff v;ill probably be talking to you folks. 



We*vG contracted v;ith the Oregon State System of Higher Education to look at 
v/hethcr there is some way we can get a state acquisition program going, and 
we have just contracted with Stanford Research' Institute to develop a study 
design for a continuing user study to. assure that future developments are 
directed toward the real information needs of educators. • ' 

Let’s consider briefly v;hat needs to be done to improve information trans- 
fer. Clearly, there is a need for increased information analysis and we’ll ‘ 
put more, money into this in the Office of Education, hut we need help from •' ^ 
other sources, '■ too. We need reports of current practice to share with educators 
all over the country and this, of course, is a place for the state agency to' 
become involved. We need a systematic way of providing referral materials.^ V7e ^ 
need more research and development and above all vre need more manpovrer. ' 
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I V70ulc1 like to leave you v.’ith juKt tliese thoughtB, XuAs eHsential that 
if there, is to bo a nystcun that really is usabile and can be. economically 
fe.asible, v;e had better find some way of waking sure that v/e don’t fractionate, 
our information seirvices. There arc tendencies, in some states, for vocational/ 
technical to go its \*?ay, exceptional education to go its v/ay, and the state 
agency V7ith the rest of its function to go its ov;n way, and the result is a 
nuKiber of incomplete systems which can’t really compote either for money orr 
for people. There is a tremendous manpov^er shortage. Unless we can find some 
way to have a eentralij'.ed state system, feeding specialis;ed competent people 
in exceptional, vocational and other areas and in turn feeding a local or 
intermediate level information system to serve the lusets, I tlrink that you’re 
going to find that the dre«nn of having useful information services in education 
is nothing but a dream — ‘it v;ill never come about, h’e must have a state system 
and we must: have more local outlets, if V7e’re going to have a system that V707;ks. 

Tv 70 questions J.*emain to be ansvrered about educational information services: 
V7ho should take leadership, and when can V7C expect a usable system to he a 
reality. Well, I can’t ansv7or tliose questions very well, because who can 
bring off an educational information system, I think, depends on you folks a 
great deal more than it does on those. of us in Washington, And wheii, that’s 
up to you, too* I’ve enjoyed meeting v;ith you. Thank you. 



